Multimedia Presentation of Interpreted Visual Data

While computer vision aims at the transformation of image data into meaningful information, research in intelligent multimedia generation addresses the e ective communication of information using multiple media such as text, graphics and video. We argue that combining the two research areas leads to an interesting new kind of information system. Such integrated systems will be able to exibly transform visual data into various presentation forms including, for example, TV-style reports and illustrated articles. The paper elaborates on this transformation and provides a modularization into maintainable subtasks. How these subtasks can be accomplished will be sketched by means of Vips, a prototype system that has emerged from our previous work on scene analysis and multimedia generation. Vips analyses short sections of camera-recorded image sequences of soccer games and generates multimedia presentations of the interpreted visual data. To appear in: Proc. of AAAI-94, Workshop on \Integration of Natural Language and Vision Processing", Seattle, WA, 1994.